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Goals of Presentation 

• Introduce engineers to risk compensation 

• Generally engineers are not expected to read economics & psychology journals 

• Relation to other theories and existing practices 

• Striking and large examples of unexpected outcomes 

• Present a quantitative equation for optimization 

• More appealing and useful to engineers than vague psych/econ theories 

• Quantitative rationale for reliability decisions, including some post-Columbia actic 

• Summary of derivation, details are in paper - http://mclsoft.com/papers 

• Brief tutorial on applying the equation 

• Discuss a few of the examples in terms of equation parameters 

• Exercise: decision / alternatives on a hypothetical space project 
commercial passenger carrier for an orbital tourism / hotel facility 
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• Engineering / Statistical hypothesis - combination of el 

assumes a fixed mission profile (i.e. user behavior does not change 
'human factors" means clarity and usability of controls, etc.) 
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Risk Management (de Mere, Pascal, Fermat, Bernoulli, de Moivre, Bayes from 17 th centun, 


rti&enn'iit Lint 


----- — - ■>"— - - r - . — j-py ] a w fr orn u J? ^ er iv 

Management hypothesis - identification, assessment 1 MASAt> arre ^ .^ suianc ^futures^____ 


http://www.slideshare.net/ricardo.vargas/ricardo-vargas-historico-gerenciamento-riscos-ppt-en http://www.moaf.org/publications-collections/financial-historu-magazine/93/ res/id=Filel/EAsk%2 



transfer, avoid, reduce or accept - assumes user behaves om 
• Includes insurance, futures & derivatives, e.g. pre-sale of farm crop 

Risk Compensation (Peltzman 1975) 


Economic hypothesis - humans & organizations optimize economic value as 
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Unexpected Outcomes 



TRAFFIC SAFETY 


SPEED LIMITS 


DAY 


Montana No-Speed-Limit 1995-1999 

• After 4 years, Montana recorded its historical low of 
number of accidents on affected roadways 
http : / / www. h wy s af e tv. com/h wy montana.htm 

• Since then accident rates have begun to rise again 

• German Autobahn accident rates are lower than USA rat 

No-Fault Auto Insurance 

• Leads to 6% increase in traffic fatalities 
Cohen & Dehijia, J. of Law & Economics 2004 

Seat Belts vs. Air Bags 

Levitt & Porter, Rev. ofEcon. & Stat. 2001 Cost per life saved: 
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Seat Belts 
Air Bags 


$30k 

$1.8M 



Unexpected Outcomes 
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LARGE GOVERNMENT PROGRAMS 
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War on Drugs - "Just Say No" - DARE 

• Pioneered in 1970s by Richard Evans at University of Houston 

• Nancy Regan phrase 1982 

• Testing by marketing experts shows: 

• "Just Say No" increased teen interest in drugs after exposure, 
promotes idea that other teens are using drugs - usage has increased! 

• DARE messages from police / authority not as effective as peer messages, 
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e.g. publication of actual drinking statistics near dorms/frats on college campus reduced drinking 3UJrr '<*tum 1 

Costs: 

• Over $1 trillion & hundreds of thousands of lives 

• $33 billion for "Just Say No", $20 billion to fight in home countries, Columbia violence moved to Mexico, now directly affei 
border regions and tourism, $121 billion to arrest and $450 billion to incarcerate non-violent offenders 
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1. USA 

716 

Be havio 

5. Rwanda 

527 

possibly 

8. Russian Federation 

502 


92. United Kingdom 

151 


123. China 

120 
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Unexpected Outcomes 

LARGE GOVERNMENT PROGRAMS #2 

• War on Cancer 

• Begun by Nixon in 1971 


OTHER 

EXPENDITURES 

(Non-t&s&sfch) 


Annual budget of the National Cancer Institute 

Adjusted tar inflation 


• Inspired by successful Moon program 

• Promised cure by 1976 


CANCER DETECTION 
RESEARCH 
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CANCER BIOLOOV 
RESEARCH 


CANCER CAUSATION 
RESEARCH 


CANCER TREATMENT 
RESEARCH 
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NYT Advances . . . " 4/23/2009 

Change in death rate or incidence: 

Cancer 

-5% death rate (since 1970s) 

Heart disease 

-64% death rate (since 1970s) 

Flu & Pneumonia 

-58% death rate (since 1970s) 

Smoking http://www.infoplease.com/ipa/A0762370.html 

-54% incidence (since 1960s) 

Illegal drug use http://www.umsl.edu/~keelr/180/trends.html 

+6% incidence (since 2002) 



Unexpected Outcomes 


MISCELLANEOUS ACTIVITIES 



Commercial Air Transportation 

• People will pay more for safety in the air - Carlsson 2002 

• Consumers learn about unobservable safety from flight outcomes - Hartmann 2001 

• Accidents adversely affect demand for other carriers 

• Airlines profits are greater if they are able to choose their optimal maintenance provision 


• Airlines AND consumers prefer an independent safety certification rather than an FAA minimum 
mokes it more profitable to provide additional maintenance 



Fire Safety Blankets 

• For a long time mainly used in USA, but USA has highest fire fighter death rate 

• USDA Forest Service concern about entrapment risk with improved 2003 fire shelter, developed with NASA he, 

• July 2005 British Columbia bans use of fire shelters to prevent entrapment 

Nuclear Energy' 
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type of energy 
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% of world electriciti 

Nuclear 

5163 total 

12.3% from 437 pla 

Fossil fuels 

300,000 per year 

69.4% 


Axioms 8 k Approximations 

• Use linear approximations 

• Equation will certainly be valid about an operating point: 

• May or may not work well for large deltas 

• Cost of innovation axiom: (equilibrium condition) 

• Corporations will engage in innovation (adding Features, new models, etc.) until there 
no incremental profit P F from doing so 

• Subsume all costs in P F except cost of the crash rate C R 

• P F - C R = 0 => C R = P F 

• Similar in concept to marginal utility of safety (Spence 1975, Savage 1999) 

• Development Crash Rate approximation 

• Divide development cost C dev by problem (bug) rate R d to get cost per development bu 

Q 

• To get total feature cost add m 

• Rewrite: R d « (C F - M)/C d 




Axioms 8 k Approximations 

CONTINUED. . . 


• Operational Crash Rate approximation 

• Use the concept of Defect ratio (defect leakage through testing process) 

• Not applicable to component wear/fatigue, but those processes are already well understood 

• Most modern failures are latent design or procedural issues: 

• All software failures, Fukushima reactor, Boeing 787 battery, Deepwater Horizon blowout, both Shuttle losses, etc. 

• Treat procedures like software, i.e. latent design issues (design of the procedure, or design of enforcement) 

• Even fatigue failures become latent design issues, i.e. they should have been caught by inspection / maintenance procedi 


It follows that the operational failure rate is the development bug rate times D: 

R 0 ~ DR d (use consistent units - per hour, flight, device, etc.) 

Substituting for R d we have R 0 ~ (C F - M)D/C d or C F « R 0 C d /D + M 


Gives a relationship between operational failure rate Rg^ndcost - il£i ^ eve iop^ ent 


• Now we can apply our eauilibrium condition - the costJ^^frroVatioj^^ a , r :u,^q ~ 

Note: £^££-2 ^ ^ 
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The Crash Rate Model 


• First, a profit axiom 

• Economic utility (Value) to users of the given Feature set: V F 

• Seller/producer will set price = V F to maximize profit: P F = V F - C F 


Combine previous axioms & solve for crash rate: 

• Apply the innovation axiom to get cost of crash crashes (failures): C R = V F - C F 

• Use operational crash rate axiom to replace C F : C R = V F - (R 0 C d /D + M) 

• Solve for crash rate: R 0 ~ (V F - M - C R )D/C d 

• Express crash costs as cost per crash C c = Cr/R^ 
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High value, easily produced 
features encourage more use 
and more risk taking =^> high R 0 
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High development 
costs lower crash rate ^ 



# 


Verification, inspectior 
analysis & quality c 
multiply the effect 
even if they are ch 



The Crash Rate Model 


iXPLAINS: 


How 6-sigma reliability helped Japanese automakers become largest in world (low "D") 

- Now virtually all cars will go 200,000 miles 

- After 20 years of competitive evolution, Japan has lost this advantage 

How Boeing, ATT & IBM dominated with expensive but reliable products (high M & C c ) 
Why you may not want to take a "fast-tracked" drug (C d too low, D too high?) 

Why your PC and phone crash a lot and are subject to hacker attacks 
(high V F , low everything else) 




Exp r ■per crash C c = Q./R^ 


R 


V f -M 


High value, easily produced 

features encourage more use 
and more risk taking =^> high R 0 
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l cost per failure (e.g. air 
iclear) => conservative & 
careful use, low R 0 
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The Bad News 
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• Competitive equilibrium 

• The formula assumes operation at the optimal profit point 

• If a company does not operate there, it will be acquired or bankrupted because others have more money 

• By culture, contracting, employee rotation & use of the same management consultants. 
Government generally operates close to the same point as industry 

• We have seen many administrations pledge to make "Government as efficient as industry" 


• Data may be unavailable for D during development, V F for gov't progr, 
(i.e. profit) 

• The Good News 




It may be possible to shortcut 20+ years of trial and error and choose a/^good" operating 
point - but we must learn how to react to new data „ ^ 


1979 Honda Civic 1979 Chevy Nova 


rw.uniquecarsandparts.com.au/car spotters guide japan 1979.htm 


http://www.detailshop.com/rides.php 


Application to Examples 
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• Montana speed limit? 

• Perception of greater risk (high R 0 ) from 

• Bad crashes with speeding driver, high C c 

• Greater risk of crash due to other driver's high D (errors) 

• Greater cognitive awareness of all risk factors vs. posted speeds which are considei 
by drivers to be conservative 

• No-fault auto insurance? 


• Reduced C c to driver, due to better insurance coverage and lack of fault penalties 

• Seat belt and air bag effects? 

• Perceived slightly lower cost C c (damage) from crashes when buckled 

• Relative to incorrectly perceived lower than actual risk/cost of unbuckled driving 

• Incorrect perception of near-immunity to CC with air bags, most crashes not head < 
poor positioning of unbuckled occupants during crash 

• i.e. bags are of almost no value unless buckled up, and most of the protection comes from the belts 


Application to Examples 
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Q + C d / 


• War on drugs? 

• Add supply-focused enforcement to cost of M 

• V F made higher by erroneous "just say no" commercials 

• User C c made lower by medical advances and free emergency room ruling 

• War on cancer? 


• D ~ 1 due to lack of a cure (all defects become operational defects) 

• Perceived V F rises as hope for cure persuades people to undertake expensive treatr 

• Air transportation? 

• C c is high and perceived higher (lottery effect, disaster avoidance effect) 

• D is very low due to independent certification & investigation 

• Dependence of V F on R 0 , value of high risk airline or airplane drops to zero 


Application to Examples 

CONTINUED 
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Q + C / 


Fire safety blankets? 

• Incorrect perception of low C c of entrapment 

Nuclear energy? 

• Perceived extraordinarily high C c of failure 

• Low D for same reasons as air transport 




We will analyze this 
in the exercise - next 



Shuttle orbiter? 

• V F is not directly measureable for non-profit space pr6jects - perhaps use total cost 

• C d and D are not known from easily accessible public records 

• Large testing costs applied to engines, avionics, tiles with many testing defects corrected high C d /D 

• SRBs and foam were considered mature (low testing?) and mapy operational defects were ignored (high D) 

• Formula is meant to analyze a change (delta) 

• After 1986, military & commercial dropped - presumably Ml lower, change in R 0 from 1/50 to 1/84 (nearly doi 

• In 1986 change from quasi-military crew to civilian (teacher) - no re-look at R 0 - compare to WWII bombing r 


Between planning and ops there was a 100 to 1 reduction in flight rate - how would this affect R 0 ? 


Project Manager Exercise: 
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G + G / 


• Commercial transport to orbital hotel / tourism facility 

• Goal is to sell tickets at V F = $1 million with recurring M < $750k per passenger 

• Using next generation SpaceX reusable launcher 20x < cost of current $133M for Dragon 7-passenger vehicle 

• 10 passenger reusable transport, dev cost $250M, 2 copies 

• 1 flight a week gives 10 x 50 x 250k = $250M/yr net revenue 

• Passengers sign waiver of liability but this is not expected to hold up in case of vehicle systems failure 

• At-fault accident liability estimated at $1B and no one will insure at reasonable price 

• Hotel & investors insist R 0 « 1 / 5 years to guarantee profits after liability 

• 1/25 years would be 1 / 1250 flights, still lOOOx more risky than a 1000 mile auto trip ( 1 fatal crash / 100M rr 


Testing program 

• 10 test flights, revealing 5 major but not fatal problems, giving C d = $50M 

• You are confident from risk analysis and test results that D < .1 (one more problem in another 10 flights) 

S1M-.75 
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1 


$15 + $50M/.l 1.5 B 6000 



seems like a pi 


good number 


S1M-.75 .25 M 1 V f -M 

Crisis: K ° a w + $50M/.l 1.55 6000 °~C c +C d / 

• After Rq publication & failure of a competing spacecraft: 

• Oops, that's only 600 flights, with a crash expected every 12 years 

• Ticket sales top out at 100 due to perceived risk, the venture will fail 

• Hedge fund offers to rescue company, alter ticket price to $5M 

• 10 flights / year, revenue of $500M, mostly profit 

• Founder asks you. . . 

• What is risk of hedge fund plan? 

• How much money do you need to meet original goal of 25 year crash interval expectancy? 
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Due to low flight rate and high 
financial pressure on each flight n 
plan expects crashes every 3.5 yec 
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Spend another $100M for 10 test f] 
(total 20) and if no problems, D < . 
& reduce ticket price $50k 


S/W Air, one of the lowest ticket price carriers, is also one of the safest 


Caveats: 
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C c +C d ! 


• Linear approximation range may be violated in this example 

• Still extremely useful for detecting direction of change and incremental amount of change 

• Static equilibrium equation only 

• Does not consider dynamics (speed), but humans respond remarkably fast, consider aviation inferences 

• All eggs in one basket equation, portfolio (Markowitz) approach unused by NASA since early 80s 

• Determination of D is not statistically valid 

• Infeasible to mount thousands of large missions 

• Use engineering analysis & inference methods along with independent verification [next slide] 
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Spend another $100M for 10 test f] 
(total 20) and if no problems, D < . 
& reduce ticket price $50k 


A Methodology Suggestion r 


HOW TO APPLY "SMARTS” EFFECTIVELY 
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Developer 

Testing 


Function similar to Shuttle SE&I 
office set up after Columbia 


Re-development as if 
test program continuing 
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Conclusions: 
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• Provides insight into effects such as mission frequency and testing 

• Economic theory (supply curve, more is more difficult) is at odds with Engineering experience (learning curve] 

• Needed to provide rapid adaptation to new technology 

• 20 years is too long to "gain experience" with current & proposed rates of introduction of new technologies 




Cheap vehicles need many test flights to lower D 

• Expensive verification is incompatible with the concept "cheap" - relying on C c restricts value of missions V F 

• Alternative (used in the exercise) is to get D very low, taking advantage of the low cost of missions for verifical 

• Need a way to account for distribution of severity of defects (often logarithmic, e.g. earthquakes, foam loss?) 






Summary of Engineering Effects 
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